• 专利附录
  • 专利说明
  • 权利要求
  • 类似技术
  • 同族专利
  • 引用文献
  • 法律状态
  • 优先权
    • 专利摘要:
    process of assisting visual exploration for an individual suffering from a pathology of the retina resulting in a scotoma. the present invention relates to assisting visual exploration for individuals suffering from pathology of the retina resulting in a scotoma and more particularly a process of assisting the visual exploration of a digital image on a display device by such an individual, the process comprising: - the recognition s10, using shape recognition software, of at least one object contained in an object zone zo of the digital image, - the determination s30 of a blind zone z1 in the image, corresponding to a position of the scotoma in the field of view of the user looking at the image, - in case of detection of a proximity of the blind zone and the object zone, the application of an image processing consisting of highlighting s70, s90 the object zone for the user.
    公开号:BR112016003520B1
    申请号:R112016003520-8
    申请日:2014-08-07
    公开日:2021-04-27
    发明作者:Carlos Aguilar；Eric CASTET
    申请人:Centre National De La Recherche Scientifique (Cnrs)；Université D' Aix-Marseille；Essilor International；
    IPC主号:
    专利说明:

    [001] The present invention relates to the mastery of the processes of assisting visual exploration for individuals suffering from a pathology of the retina resulting in a scotoma, such as an age-related macular degeneration (DMLA), Stargardt's disease or maculopathies .
    [002] The invention relates more particularly to a process of assisting the visual exploration of a digital image on a display device by an individual suffering from a pathology of the retina resulting in a scotoma.
    [003] DMLA, Stargardt's disease or maculopathies can cause visual impairments resulting in the progressive destruction of central vision and the development of a blind spot called "scotoma", which suppresses the information that reaches the foveal region. This information is essential for the performance of some daily tasks such as reading or, more generally, the recognition of objects in an image. The absence of therapies capable of definitively eliminating this disease forces the individual to opt for assistance processes that are often of an optical nature.
    [004] There is, therefore, a need to provide a process that facilitates the visual exploration of an image, such as, for example, navigation in a text, that is capable of adapting to the individual's pathology and that uses neuroscience principles. visuals to better assist the individual, even increase their reading performance.
    [005] A known solution is described in US 2012/0200595. The system consists of information glasses equipped with an oculometer. If the user is an individual suffering from DMLA, the system takes into account the area of the individual's visual field that is covered by his macular scotoma. First, the glasses capture the image of a scene and project it onto ophthalmic lenses. Then, the oculometer implanted in these glasses allows to measure the position of the gaze on the projected image. The user can activate the enrichment of the image zone that is covered by his scotoma. The enrichment of this image area can be either an increase in its size, or the increase and displacement of its lines, or a movement and deformation of its lines around the scotoma.
    [006] According to this system, the position of the gaze and the size of the scotoma are used to define the enriched information near the scotoma. It is thus able to adapt to the characteristics of the scotoma of each individual. However, although the image processing proposed by this system takes into account the pathology of the individual's retina, the enrichment carried out does not take into account fundamental aspects of reading in the presence of a macular scotoma. In effect, this system only acts on the pixels of the image zone, to move the information covered by the scotoma. Therefore, it does not allow to optimize the interaction between the position of the gaze, the size of the scotoma and the entities «words» and «letters» of the text. In addition, this system does not propose a subjection of the gaze that takes into account ocular motor events in the absence of central vision, which is, however, necessary to optimize the eye movements of individuals suffering from retinal pathology. Therefore, this system may not be effective in terms of comfort and in particular in terms of reading performance.
    [007] In this context, the present invention aims to minimize one or several of the inconveniences previously mentioned by proposing a process to assist the visual exploration of a digital image on a display device by an individual suffering from a pathology of the retina resulting in a scotoma, the digital image being formed by a matrix of points divisible into areas.
    [008] To that end, the process of the invention is essentially such that it comprises the steps consisting of:
    [009] - recognize, with the help of shape recognition software, at least one object contained in an object area of the digital image,
    [0010] - determine a blind zone in the image, corresponding to a position of the scotoma in the field of vision of the user who looks at the image,
    [0011] - in case of detection of a proximity of the blind zone and the object zone, apply an image processing, of evidence of the object zone for the user.
    [0012] The process thus allows advantageously not only to use the position of the gaze and the size of the scotoma in order to define the information to be reproduced in an enriched way, but also to detect different objects of the image, to specifically identify those that the individual explores or you want to visually explore and optimize the enriched display of that object in order to compensate for the factors that limit your vision.
    [0013] The words "forms" and "object" as used above are to be considered in a very general sense. It is not just a geometric shape, but any kind of extractable visual characteristics, global, local or semi-local, from the digital image. The forms or reasons for recognizing them can be of very different natures. They can consist of objects, faces, lines of text, words, letters, etc. at the same time.
    [0014] According to a particular feature of the process, it also comprises the steps consisting of:
    [0015] - determine a zone of interest comprising at least one object zone, according to a criterion for positioning the blind zone on the digital image, the blind zone being positionable on the display device by subjecting to a pointing device.
    [0016] - display on the display device a mark allowing the visualization of the determined area of interest, and
    [0017] the highlighting of the object zone consists of enriching the determined area of interest by modifying it and reproducing it in a vision zone according to at least a predetermined processing.
    [0018] The process thus advantageously allows visually informing the individual that he can enrich an object recognized by its automatic marking.
    [0019] According to another peculiarity of the process, the positioning of the blind zone on the digital image according to which the zone of interest is determined is chosen from:
    [0020] - a criterion of overlapping the zone of interest by the blind zone, and
    [0021] - a criterion of overlapping the zone of interest by a preferential fixation zone determined for each individual, the positioning of that preferential fixation zone on the display device being in relation to the positioning of the blind zone on that same device.
    [0022] According to the previous particularity, the said overlap criterion consists of determining:
    [0023] - the positioning of a specific point in the blind zone or the preferential fixation zone on the zone of interest, or
    [0024] - a larger area of overlap of the zone of interest by the blind zone or by the preferential fixation zone.
    [0025] According to another peculiarity of the process, when the zone of interest is located near an edge of the display device so that the viewing zone would only be partially reproduced on the display device according to said predetermined processing, the enrichment of the zone of interest also consists of moving the viewing area so that it is reproduced entirely on the display device and has a substantially maximum overlap with the viewing area that would only be partially reproduced on the display device. according to said predetermined processing.
    [0026] According to another peculiarity of the process, the evidence of the object zone is commanded by the individual triggering, and eventually keeping triggered, a trigger, and the process comprises, in addition, a step of returning to the digital image before enrichment, this return being commanded by the individual by triggering, and eventually by slowing down, the trigger, respectively.
    [0027] The process according to this particular feature thus allows the individual to advantageously control the duration of the enrichment.
    [0028] According to another peculiarity of the process, at least one zone between the blind zone and the viewing zone comprises a visible marking on the display device.
    [0029] The process according to this particularity thus allows advantageously to help the individual to be aware of the extent of his scotoma to allow him to optimize his eye movements. In addition, if the process is more of an assistance process for reading on a text display device, the process according to this particular feature allows, moreover, advantageously helping the individual to stabilize himself vertically on the line he is reading .
    [0030] According to a first mode of carrying out the process, the shape recognition software comprises an object segmentation algorithm in relation to the background, which is based on the principle of figure-background segregation used in automatic image processing.
    [0031] The process according to this first embodiment is thus advantageously adapted for the local or semi-local recognition of objects, faces or geometric shapes.
    [0032] According to a particularity of the first mode of carrying out the process, the predetermined processing of the zone of interest consists of the progressive enlargement of its size and eventually its progressive displacement from its initial position in the digital image until it occupies on the display device the the vision zone and the process comprises, in addition, a step of returning to the digital image before enrichment consisting of a progressive decrease in the size of the enriched zone of interest and eventually a progressive displacement of its position until its return to its size and its position before enrichment.
    [0033] The process according to this particularity of the first embodiment thus advantageously allows the individual to maintain a memory of the initial position of the zone of interest in the digital image, namely to facilitate the subsequent visual exploration of the rest of the digital image. The displacement of the position of the enriched zone of interest also makes it possible to make the vision zone more advantageously coincide with a preferred fixation zone determined for each individual.
    [0034] According to a second way of carrying out the process, the process of assisting visual exploration is a process of assisting reading; the digital image comprises a text to be read; the shape recognition software comprises character recognition software, allowing you to recognize at least part of the text by segmenting it into line zones, then by segmenting each line zone into word zones; the object zone is a word zone; the vision zone is located on the periphery of the blind zone.
    [0035] The process according to its second mode of realization thus allows advantageously not only to use the position of the look and the size of the scotoma to define the information to be reproduced in an enriched way near the scotoma, but also to detect different words of the image, specifically identify a group of words that the individual wishes to read, visually inform the individual that he can enrich that group of words by automatically marking the latter and optimize the enriched display of that group of words in order to compensate for the factors limiting his reading ability. It should also be noted that the fact that the image is segmented into word zones allows full words to be reproduced in the viewing area.
    [0036] According to a particularity of its second embodiment, the process comprises, in addition, prior to the determination of the area of interest, a step consisting of modifying the text image by its resizing and / or by modifying the spacing of the text. between lines depending on the size of the characters, the length and / or the number of lines, the size of the display device and / or the size of the blind area.
    [0037] The process thus advantageously allows the maximum amount of global information about the text to be displayed so that the individual can orient himself in it without having to move the image permanently.
    [0038] In accordance with another feature of its second embodiment, the recognition of said at least a part of the text comprises, in addition, the segmentation of each word zone into letter zones.
    [0039] The process according to its second form of realization thus allows advantageously a modification and a more finely controlled reproduction of the words located in the area of interest.
    [0040] According to another particularity of the second mode of carrying out the process, the zone of interest comprises, in addition to said at least one word zone, at least two other word zones belonging to the same line zone, each word zone of the zone of interest being juxtaposed with another word zone of the zone of interest.
    [0041] The process thus allows advantageously to adapt the assistance provided to the individual in his visual memory.
    [0042] According to another particularity of the second embodiment of the process, said at least one predetermined processing of the zone of interest consists of:
    [0043] - a segmentation of each word zone into character zones, and / or
    [0044] - an increase in the size of the characters according to the size of the blind zone, and / or
    [0045] - a change of font, and / or
    [0046] - an arrangement of words on several lines, and / or
    [0047] - a hyphenation of a word, and / or
    [0048] - an increase in the spacing between characters, and / or
    [0049] - a modification of the contrast, and / or
    [0050] - an inversion of polarity, and / or
    [0051] - a vocal synthesis of the words contained in the area of interest.
    [0052] The process according to its second form of realization thus allows advantageously to modify each one of the words of the zone of interest differently.
    [0053] According to a variant of the previous feature, the size of the characters and / or the spacing between the characters are increased as the characters are intended to be reproduced on a line of the vision zone furthest from the blind area.
    [0054] The process thus advantageously allows to limit, even eliminate, the phenomenon of visual congestion.
    [0055] In accordance with another feature of the second method of carrying out the process, in addition, a zone of previous interest and / or a zone of next interest, respectively located on both sides of a zone of current interest, are determined, at least one of these zones comprising a visible marking on the display device.
    [0056] The process according to its second form of realization thus advantageously allows to avoid that the same group of words is enriched several times and / or that successive zones of interest have zones of words in common, or at least allows to indicate to the individual these occurrences. In addition, the process can also advantageously allow the individual to indicate the next group of words to enrich.
    [0057] According to another feature of its second embodiment, the process also comprises a step that consists of displaying on the display device a mark to the left of the line zone located directly below the line zone comprising the zone of interest.
    [0058] The process according to its second mode of execution thus advantageously allows the reader to be assisted at the time of a passage to the next line, this passage being particularly difficult at the time of a reading in a decentralized view.
    [0059] According to a particularity of its first and second embodiments, the process comprises, prior to the reproduction in the viewing zone of the processed area of interest or prior to the determination of the zone of interest according to a choice of the said criteria of positioning, a step that consists of determining the peripheral position of the vision zone in relation to the blind zone as corresponding to the position of a preferred fixation zone determined for each individual.
    [0060] The process thus advantageously allows to optimize, in an adapted way for each individual, the effectiveness of subjecting the gaze in the absence of macular vision.
    [0061] According to the previous particularity, the determination of the peripheral position of the vision zone in relation to the blind zone comprises the calibration steps consisting of:
    [0062] - display on the display device a plurality of targets,
    [0063] - for each target, detect, by means of an oculometer, the relative position of the individual's scotoma in relation to the target when the individual fixes the target, and
    [0064] - calibrate the position of the preferential fixation zone as being the relative position of the target in relation to the position of the scotoma, and
    [0065] - if, the scotoma's relative position in relation to the target's position varies depending on the target,
    [0066] - subject, depending on the calibration carried out in accordance with the previous detections, the positioning of a contour in a visualized way on the display device of the scotoma position detected by the oculometer,
    [0067] - display a symbol of the fixed target on the display device,
    [0068] - measure the displacement between the slave contour and the target symbol, when the individual positions the slave contour in order to include the target symbol in it, and
    [0069] - correct, according to this measurement, the calibration performed according to the previous detections.
    [0070] According to another feature of the first and second modalities of carrying out the process, the vision zone is located in a juxtaposed way and centered below or above the blind zone.
    [0071] The process according to its first and second modes of realization thus allows the individual to advantageously identify the largest number of visual characteristics, such as letters, in a single fixation and thus increase their visual memory. In addition, the process according to this other feature allows the individual to maintain, even during the viewing of the vision zone, his preceptive memory intact.
    [0072] According to another particularity of the first and second modalities of carrying out the process, the pointing device subjecting the positioning of the blind zone is chosen between a computer keyboard, a mouse and an oculometer.
    [0073] The invention relates, according to another aspect, to a computer program comprising instructions for implementing the process according to any of the preceding claims, when that program is executed by a processor.
    [0074] The advantages achieved by the computer program, as briefly explained above, are at least identical to those mentioned above in connection with the process according to the first aspect of the invention.
    [0075] Other features and advantages of the invention will clearly emerge from the description that is given below, as an indicative and non-limiting title, with reference to the attached drawings in which:
    [0076] - figure 1 illustrates the evolution of maximum reading speeds in central view and in peripheral view depending on the size of the characters read,
    [0077] - figure 2 illustrates the visual memory (left) and the effect of the size of the visual memory on the reading speed (right),
    [0078] - each of figures 3a and 3b illustrates the phenomenon of visual congestion and a way of suppressing this phenomenon according to the invention,
    [0079] - figures 4a, 4b, 4c and 4d illustrate several variants of the second embodiment of the process according to the invention,
    [0080] - figure 5 illustrates a particularity of the second embodiment of the process according to the invention,
    [0081] - figure 6 illustrates another particularity of the second embodiment of the process according to the invention,
    [0082] - figures 7a and 7b illustrate a way of carrying out the determination of the peripheral position of the vision zone in relation to the blind zone,
    [0083] - figure 8 represents a flowchart of the stages of the process according to its first and second realization modalities, and
    [0084] - figures 9a and 9b illustrate a particularity of the process according to the invention in its second embodiment, and
    [0085] - figure 10 illustrates the first embodiment of the process according to the invention.
    [0086] In its broadest acceptance, the invention relates to a process S of assisting the visual exploration of a digital image I on a display device D by an individual suffering from a pathology of the retina resulting in a scotoma. Digital image I is formed by a matrix of points divisible into areas.
    [0087] Process S comprises the steps consisting of:
    [0088] - recognize S10, with the help of a shape recognition software, at least one object contained in a ZO object zone of the digital image,
    [0089] - determine S30 a blind zone Z1 in the image, corresponding to a position of the scotoma in the field of view of the user who looks at the image,
    [0090] - in case of detection of a proximity of the blind zone and the object zone, apply an image processing, of evidence S70, S90 of the object zone to the user.
    [0091] Process S thus advantageously allows not only to use the position of the eye and the size of the scotoma to define the information to be reproduced in an enriched way, but also to detect different objects of the image I, to specifically identify those that the individual explores or desires explore visually and optimize the enriched display of that object in order to compensate for the factors limiting your vision.
    [0092] Process S comprises, in addition, the steps consisting of:
    [0093] - determine S50 a zone of interest Z2 comprising at least one zone of object ZO determined, according to a criterion of positioning the blind zone Z1 on the digital image,
    [0094] - display S60 on the display device an MZ2 mark allowing the visualization of the determined zone of interest Z2.
    [0095] In addition, highlighting the object zone S70, S90 consists of enriching the determined zone of interest Z2 by modifying it S70 and reproducing it S90 in a zone of vision Z3 according to at least one predetermined processing.
    [0096] In the same way that the individual's gaze travels through the digital image I, the blind zone Z1 must be able to be freely positioned by the reader on the display device D and more particularly on the digital image I. This is accomplished by subjecting the positioning of the zone blind Z1 on a pointing device, such as a computer keyboard, a mouse or preferably an oculometer.
    [0097] The process thus advantageously allows the individual to be visually informed that he can enrich an object recognized by its automatic marking. Indeed, the MZ2 marking of the zone of interest Z2 allows the individual to be aware of the recognized object that can enrich.
    [0098] The marking of any zone, and the zone of interest Z2 in particular, consists of making the graphic element stand out (or more particularly the text part according to the second embodiment described below) constituting that zone by modifying its visual attributes. As an example, the marking may consist of an outline and / or a highlight of the area.
    [0099] According to a particularity of process S, the positioning criterion of the blind zone Z1 on the digital image I according to which the zone of interest Z2 is determined is chosen from:
    [00100] - a criterion of overlapping the zone of interest Z2 by the blind zone Z1, and
    [00101] - a criterion of overlapping the zone of interest Z2 by a preferred zone of PRL fixation determined for each individual, the positioning of this preferential zone of fixing PRL on the display device D being in relation to the positioning of the blind zone Z1 on this same device.
    [00102] In accordance with the preceding particularity, the said overlapping criterion consists of determining:
    [00103] - the positioning of a specific point in the blind zone Z1 or the preferential PRL fixation zone on the zone of interest Z2, said specific point being, for example, the center or the lower right corner of the considered zone, or
    [00104] - a larger overlapping area of the zone of interest Z2 by the blind zone Z1 or by the preferred PRL fixation zone.
    [00105] The overlapping criterion for determining a larger overlapping surface really needs some simple geometric calculations, with examples based on the coordinates of each recognized object. These calculations are considered to be within the competence of the person skilled in the art.
    [00106] As illustrated in figures 9A and 9B in relation to the second embodiment of the process, but the particularity illustrated by that figure is not limited to this embodiment, it may be worthwhile that the zone of interest Z2 is located close to an edge of the display device D so that the viewing zone Z3 would only be partially reproduced on the display device D according to said predetermined processing. Then, according to a particularity of the process S, the enrichment of the zone of interest Z2 consists, in addition to the modification S70 and the reproduction S90 of the zone of interest Z2, in moving the zone of vision Z3 so that it is entirely reproduced on the device This movement is preferably carried out in such a way that the viewing zone Z3 thus moved has a substantially maximum overlap with the viewing zone Z3 which would only be partially reproduced on the display device D according to said predetermined processing. This preference is more marked than the position of the vision zone Z3 in relation to the blind zone Z1 is chosen as corresponding to the position of a preferred fixation zone determined for each individual, for example, according to the test described below.
    [00107] According to another particularity of the S process, the evidence of the object zone or the enrichment of the determined zone of interest Z2 is commanded by the individual by activating a trigger and the process can comprise, in addition, a step of returning to the digital image I before enrichment, this return being commanded by the individual also by activating the trigger. Eventually, the triggering of the trigger can be maintained by the individual and eventually the step of returning to digital image I before the enrichment is commanded by slowing down the trigger.
    [00108] Process S according to this particularity thus allows the individual to advantageously control the trigger and the duration of enrichment.
    [00109] According to another particularity of the S process, in addition to the necessary MZ2 marking of the zone of interest Z2, at least one zone between the blind zone Z1 and the viewing zone Z3 comprises a visible marking on the display device.
    [00110] The process thus advantageously allows to help the individual, not only to stabilize himself in the recognized object that he wants to enrich, but also to be aware of the extent of his scotoma that allows him to optimize his eye movements.
    [00111] The process according to its first embodiment illustrated in figure 10 is essentially how the shape recognition software comprises an object segmentation algorithm in relation to the background that is based on the principle of figure-background segregation used in processing automatic image.
    [00112] The process according to this first embodiment is thus advantageously adapted for the local or semi-local recognition of objects, faces or geometric shapes.
    [00113] Figure 10 indicates drawings representing the same photo of three characters together with the blind zone Z1 representing the scotoma of the individual. At least one face of one character over the three was recognized as an object to be enriched. As illustrated in the photo in the center of figure 10, the individual bringing, according to the positioning criterion described above, the blind area on that face sees a (black) outline appear around it so that he is informed of the possibility that he has it is offered to enrich the recognized face, for example, as illustrated in the drawing on the right of figure 10.
    [00114] According to a particularity of the first embodiment of process S, the predetermined processing of the zone of interest Z2 consists as shown in the photo on the right of figure 10 in the enlargement of the size of the zone of interest Z2, or equivalent of the zone of interest. ZO object, comprising the recognized object. In addition, it is proposed in accordance with this embodiment that this enlargement is progressive in size until it occupies the Z3 vision zone on the display device D. This enlargement can, on the other hand, be directly directed by the individual, for example, through the wheel of your mouse.
    [00115] Eventually, a progressive displacement of the ZO object zone from its initial position in the digital image I can be carried out advantageously so that the enriched object is located in the center of the vision zone, especially when the position of the vision zone Z3 in relation to the blind zone Z1 it is chosen as corresponding to the position of the preferred zone of fixation PRL.
    [00116] According to this particularity of its first embodiment, the S process can also comprise a step back to digital image I before enrichment consisting of a progressive reverse decrease in the size of the enriched zone of interest Z2, and eventually in a progressive reverse displacement of its position, until it returns to its size and position before enrichment.
    [00117] The process according to this particularity of the first embodiment thus advantageously allows the individual to maintain a memory of the initial position of the zone of interest in the digital image, namely to facilitate the subsequent visual exploration of the rest of the digital image. The displacement of the position of the enriched zone of interest Z2 also makes it possible to advantageously match the zone of vision Z3 in the best way with the preferred zone of fixation PRL determined for each individual.
    [00118] According to its second embodiment, the S process refers more particularly to an assistive process for reading on a text display device intended to be read by an individual suffering from a retinal pathology resulting in a scotoma described further below with reference to figures 1 to 9.
    [00119] The text is part of a digital image I formed by an array of dots. Like any dot matrix, that component of the text image is divisible into zones. Each zone is preferably made up of a single parcel.
    [00120] It can first be proposed, so that the process according to the invention allows to assist the reader in the best way, maintaining, in the display device D, the maximum global information about the text, namely so that the individual can orient himself easily on it without having to move the image permanently, for example, with the help of scroll bars.
    [00121] For this purpose, the process comprises a step consisting of modifying the image of the text. This modification may consist of a resizing of the digital image I. For example, the text image is resized so that the lines of the text begin at an edge of the display device D where the image of the text is displayed and end in front of a opposite edge of the display device, so that it is not necessary for the reader to move the image during its reading, with a corresponding scroll bar at the end and beginning of each line of text.
    [00122] Such resizing can automatically induce a change in the leading spacing, but it is also suggested that this last change can be carried out independently.
    [00123] This step of modifying the image is preferably carried out taking into account at least one parameter between: the size of the characters, the length and / or the number of lines, the size of the display device and / or the size of a zone blind call Z1 representing the scotoma of the individual on the display device. For example, the text image is resized so that the blind area does not cover more than two portions of successive lines.
    [00124] With reference to figure 8, the process according to the invention comprises a step consisting of recognizing S10, through a character recognition software, at least a part of text by its segmentation in ZL line zones, then by segmentation of each line zone into ZM word zones. The recognition software designates a computer process for translating images of printed or typed texts into text files, such as optical character recognition software (ROC). When the image segmentation in the word zone is performed, the coordinates of each word are detected so that they can be used.
    [00125] Referring to figure 8, the process according to the invention further comprises a step consisting in determining S30 the blind zone Z1. This blind zone represents the individual's scotoma on display device D. Preferably, this blind zone contains the scotoma entirely. The shape of this zone can, for example, be adapted to the shape of an individual's scotoma, usually roughly in the form of a disc, or be defined by default, for example, in a rectangular shape.
    [00126] The process according to its second embodiment comprises, in addition, a step consisting in determining S50 a zone of interest Z2 comprising at least one zone of word ZM.
    [00127] According to the second embodiment of the process, the positioning and overlapping criteria are as described above. Thus, depending on the strategy adopted by the individual, the words included in the zone of interest Z2 may, for example, be located under or near the edges of the blind zone Z1.
    [00128] According to the second mode of carrying out the process, some simple geometric calculations necessary to determine a larger overlapping surface are based on the detection of the coordinates of each word zone and eventually of each letter zone. It should be noted that, as illustrated by a comparative analysis of figures 4c and 4d, the successive line zones and word zones are not necessarily juxtaposed, for example, so that the sum of all zones fully covers the image of the text , but on the contrary can be slightly spaced apart by empty areas of text.
    [00129] As in accordance with the first mode of carrying out the process, the zone of interest Z2 determined according to one of the positioning or overlapping criteria described above is displayed S60 on the display device through an MZ2 marking that allows its display .
    [00130] Referring to figure 8, the process according to the invention further comprises a step consisting of modifying S70 the zone of interest Z2 according to at least a predetermined processing and a step consisting of reproducing S90 the zone of interest Z2 processed in a vision zone Z3 located on the periphery of the blind zone Z1. The S70 modification and the S90 reproduction, or the only S90 reproduction, are, for example, controlled by the individual by pressing a mouse button or a keyboard key.
    [00131] According to a second embodiment of the process, the S10 recognition of said at least a part of the text comprises, in addition, the segmentation of each word zone into letter zones. The process thus advantageously allows a S70 modification and a more finely controlled S90 reproduction of the words located in the area of interest, for example, by a deformation by rolling the letters of the word group to enrich or by increasing the size of the furthest letters from the center of the scotoma more important than that of the letters closest to the center of the scotoma. When the image is segmented into letter zones, the coordinates of each letter zone are detected so that they can be used.
    [00132] The enrichment carried out in accordance with the second method of carrying out the process advantageously takes into account fundamental aspects of an exercise in reading in the presence of a macular scotoma. In effect, this enrichment is not content to move the information covered by the scotoma (by resizing or deforming the image of the text), but recognizes the image words, allows to specifically identify those that the individual wants to read and optimizes the display of those words in a way to compensate for factors that limit reading in the presence of a scotoma. These advantages, although remaining inaccessible, without segmenting the image into words, cannot, however, be achieved via this single characteristic that must be combined for steps S50, S70 and S90 of the process according to the second mode of carrying out the process to assist intelligently and effectively the reader.
    [00133] To better understand this, it is necessary to explain certain notions of visual neurosciences such as the preferential fixation zone (PRL), visual congestion, acuity and visual memory. These notions allow to act both in the perceptual plane and in the oculus motor plane.
    [00134] With reference to figure 1, it was established that the accuracy in the decentralized view benefits from a gain in terms of reading speed, when the size of the text characters is increased. However, the simple increase of the size of the characters in the peripheral view (b), in healthy individuals in condition of presentation of successive visual objects at a high speed or RSVP (for Rapid Serial Visual Presentation), does not allow to reach the speed thresholds obtained in the foveal view (a). The graph in figure 1 (Legge et al. 1985a; Legge et al. 1985b) shows read speed measurements, placed in ordinate, depending on the size of the characters read, placed in abscissa. Figure 1 illustrates, therefore, the reading performances according to the size of the characters for individuals who use their normal vision (a) and individuals who use their peripheral vision (b).
    [00135] With reference to figure 2, visual memory is defined as an essential notion in the framework of studies on reading. Corresponds to the extension of the visual field where the letters can be identified outside any linguistic information. Quantifies the number of letters that can be identified from a fixation without resorting to context. The image on the left of figure 2 illustrates the notion of visual memory (EV). If the individual's gaze fixes the center of the circle containing the words, then his visual memory corresponds to the words "this must". The graph to the right of figure 2 (O’Regan 1979 and O’Regan et al 1983) has the effect of the size of visual memory (in abscissa) on the reading speed (in ordinate). This image shows the following phenomenon: the reading speed increases with the size of the visual memory.
    [00136] In reference to figure 3a, visual congestion is the product of a spatial interaction between adjacent letters of a word, or between the words themselves. If the letter (or word) to identify has a sufficiently large area of isolation, congestion has no effect on its identification. On the contrary, when other letters (or words) are present within that zone, the identification of the letter in question is disturbed. The size of the spatial zone (called the isolation zone) necessary to avoid the phenomenon of visual congestion increases in proportion to the eccentricity. Figure 3a allows to demonstrate it. Fixing the middle cross, it is easy to identify the letter "r" on the left. However, the letter "r" on the right is impossible to identify; to identify, it is necessary to fix the little cross located to the left of the letter "a" (Pelli and Tillman, 2007).
    [00137] The preferential PRL fixation zone is defined as the vision zone to which the attention is implanted, in the presence of a scotoma. In fact, when a central scotoma is present, the center of the retina cannot be used to identify a target and the individual is obliged to show his attention outside the affected area, thus dissociating his gaze from the area where the attention is implanted. The preferred fixation zone, therefore, is spontaneously moved, in the presence of a scotoma, to one or more zones of healthy Z3 vision of the extra foveal retina. At the time of a task of fixing a target by an individual, these preferred zones of fixation are detectable and positionable, for example, with the help of an oculometer.
    [00138] Thus, it is evident that, prior to determining S50 of the zone of interest Z2, the step of modifying the image of the text allows placing the characters of the text in a size that allows the individual to read each of the words by placing themselves on the threshold of word acuity according to the size of the scotoma. This size of the characters in the text is large enough to allow the individual to have a correct reading with his scotoma, but not too large to prevent the loss of global information about the text. The leading spacing of the text can be increased, depending on the size of the scotoma, so that the individual can better position his scotoma on the line during reading.
    [00139] With reference to figure 3b, according to a particularity of the second mode of carrying out the process, said at least one predetermined processing of the zone of interest Z2 consists of a segmentation of each word zone into zones of characters (or of letters) and an increase in the spacing between the characters, in order to limit, even avoid, the phenomenon of visual congestion. Figure 3b illustrates this by showing, on the left, a word whose spacing between letters is normal, which makes it difficult to identify it in the off-center view (fixing the cross to the left), and on the right, a word whose spacing between letters increases, which makes it easier to identify in the off-center view (fixing the cross to the right).
    [00140] According to another feature of the second mode of carrying out the process, the zone of interest Z2 may comprise, in addition to said at least one covered word zone, at least two other word zones belonging to the same line zone, each word zone of the zone of interest Z2 being preferably juxtaposed with another word zone of the zone of interest Z2. The process thus advantageously allows taking into account the size of each word zone and adapting the assistance provided to the individual in his visual memory.
    [00141] In addition, according to another feature of the second mode of carrying out the process, a feature already introduced above in reference to the first mode of carrying out the process, at least one zone between the blind zone Z1 and the viewing zone Z3 comprises a visible mark on the display device. The process according to this particular feature thus advantageously allows the individual to further help to stabilize himself vertically on the line he is reading. In addition, as illustrated in figures 4a to 4d, the blind zone Z1 is delimited by a contour and the presence of that contour helps the individual to be aware of the boundaries of his blind spot and allows him to optimize his eye movements.
    [00142] In the example illustrated in figure 4a, starting from a high position in relation to a sentence in the text, the blind zone Z1 is guided by the individual thanks to the pointing device over the group of words that he wants to enrich. The zone of interest Z2 is displayed to help the individual to be positioned on his target. The predetermined processing or enrichment of the zone of interest Z2 consists, according to this example, of an increase in its size, an increase whose amplitude may, for example, depend on the size of the blind zone Z1.
    [00143] It should be noted that, in figure 4a, as in figure 4b, the blind zone Z1 is placed in transparency to see the words it covers, while in the real situation, the words covered by the blind zone are covered for the individual by the scotoma and are therefore invisible as illustrated in figures 4c and 4d.
    [00144] In the example illustrated in figure 4b, process S according to the second embodiment is implemented in the same way as the example examined above with reference to figure 4a, except that the enrichment of the zone of interest Z2 consists not only of an increase in its size, but also in a breakdown of words comprising several lines, in the present case two lines, of the Z3 vision zone.
    [00145] In the example illustrated in figure 4c, process S is implemented in the same way as the example examined above with reference to figure 4b, except that the enrichment of the zone of interest Z2 consists, in addition, by the size of the characters and / or the spacing between the characters is further increased as the characters are reproduced S90 over a line of the Z3 vision zone furthest from the Z1 blind zone.
    [00146] In the example illustrated in figure 4d, process S is implemented in the same way as the example examined above in reference to figure 4c, except that the zone of interest Z2 comprises a long word zone ZM and the enrichment of that zone of interest it also consists of a hyphenation of the word long.
    [00147] According to an embodiment of the process, and as illustrated in figure 5, a zone of previous interest Z20 and / or a zone of next interest Z22 located respectively on both sides of a zone of current interest Z21 (determined for step S50) are furthermore determined. In the example shown in figure 5, each zone Z20, Z21 and Z22 comprises a visible contour on the display device.
    [00148] According to a particularity of its second embodiment, and with reference to figure 6, the process also comprises a step consisting of displaying a Z4 mark on the display device to the left of the line zone located directly below the line zone comprising the zone of interest Z2. The line break is an important problem when reading a text in a decentralized view. Figure 6 shows how a Z4 mark, here a black rectangle, to the left of the text can help to locate the beginning of a next ZL line zone. In this example, the S process allows you to choose the words located under the bottom edge of the scotoma. The black rectangle is displayed when the individual places the edge of his scotoma in a zone of interest Z2 of a zone of line ZL which is precisely above and remains displayed for a few seconds, for example, for 3 seconds. Thus, when the individual moves from one line to another (right image), the zone of interest Z2 is precisely next to the black rectangle Z4. If the individual misses the line, the black rectangle Z4 is not on the same line as the zone of interest Z2 and the individual thus realizes that he is not on the subsequent line.
    [00149] According to a particularity of the first and second modalities of carrying out the S process, a test aiming to choose the preferred zone of PRL fixation, possibly vertical, by the individual is carried out to display the enriched words in an optimum position of the visual field of the individual.
    [00150] Thus, according to this embodiment, the S process comprises, previously for the S90 reproduction in the Z3 vision zone of the processed Z2 zone of interest, a step consisting in determining the peripheral position of the Z3 vision zone in relation to to the blind zone Z1 as corresponding to the position of a preferred fixation zone determined for each individual, for example, taking into account the position and size of the scotoma.
    [00151] More particularly in accordance with this embodiment, and with reference to the two images on the left of figure 7a, the determination of the peripheral position of the Z3 vision zone in relation to the Z1 blind zone comprises the calibration steps consisting of:
    [00152] - display on the display device a plurality of F targets,
    [00153] - for each target F, detect, through an oculometer, the relative position of the individual's scotoma S in relation to the target when the individual fixes the target, and
    [00154] - calibrate the position of the preferential PRL fixation zone as being the relative position of target F in relation to the position of scotoma S.
    [00155] This calibration is sufficient if, for each target F, the relative position of scotoma S in relation to the target is the same. If not, it is preferable to consider a calibration correction that may be in accordance with the following variant.
    [00156] According to this variant, and with reference to the image on the right of figure 7a and figure 7b, if the relative position of scotoma S in relation to the position of target F varies depending on the target, the determination of the peripheral position of the vision zone Z3 in relation to the blind zone Z1 comprises the calibration steps consisting of:
    [00157] - display on the display device a plurality of F targets,
    [00158] - for each target F, detect, through an oculometer, the relative position of the individual's scotoma S in relation to the target when the individual fixes the target,
    [00159] - calibrate the position of the preferential PRL fixation zone as being the relative position of the target in relation to the scotoma position,
    [00160] - subject, depending on the calibration carried out in accordance with the preceding detections, the positioning of a contour of CF shape displayed on the display device for the scotoma S position detected by the oculometer,
    [00161] - display a fixed C symbol on the display device,
    [00162] - measure the displacement d between the slave contour and the target symbol, when the individual has positioned the CF slave contour in order to include the target symbol C in it, and
    [00163] - correct, according to this measurement, the calibration performed according to the previous detections, in order to calibrate the relative position of the preferential fixation zone in relation to the scotoma position.
    [00164] According to another variant of the test aiming to choose the individual's preferred fixation zone, the individual himself can manually adjust the Z3 vision zone to optimize his wearing comfort.
    [00165] The Z3 or RVA vision zone (for Augmented Vision Region) is then preferably displayed over the individual's preferred PRL fixation zone.
    [00166] In all of the above examples relating to the second embodiment of the process, the individual's preferred PRL fixation zone is assumed to have been determined according to a test described above as being vertical and located under the scotoma, in accordance with the scotoma. so that, as shown, the vision zone Z3 is located in the vertical of the blind zone Z1 and under it.
    [00167] According to a particularity of the second mode of carrying out the process, the center of the Z3 vision zone is preferably aligned with the center of the Z1 blind zone, which allows the individual to identify the largest number of letters in a single fixation and thereby increasing your visual memory.
    [00168] It should be noted that, according to the second mode of carrying out the process, the zone of interest Z2 remains preferably visible while the zone of vision Z3 is displayed.
    [00169] According to a second embodiment of the process, as the zone of interest Z2 is located near an edge of the display device D so that the viewing zone Z3 would only be partially reproduced on the display device D of according to said predetermined processing it can also induce a limitation of the zone of interest to the word zone which is closest to the edge of the display device. In this case, the process advantageously provides that other word zones located in the same line zone, on the opposite side of the edge of the display device, are also selected as predicted in the zone of interest to continue to fully use the individual's visual memory, even in this situation.
    [00170] It should also be noted that, according to the second mode of carrying out the process, the fact of segmenting the text of the image in word zones allows to reproduce S90 of the entire words in the Z3 vision zone.
    [00171] It should also be noted that, according to a second mode of carrying out the process, the text of the image can be fully recognized S10 at once by the character recognition software. However, in a non-limiting way, only a part of the text can be recognized that would, for example, be selected by the reader on the image by a movement of the mouse together with a pressure on its left button. Another part of the text could then be selected in the same way. For another example, only a part of the line of text covered by the blind zone or a part of the text located around the blind zone is recognized S10. In addition, recognition S10 and the other steps from S30 to S90 of the process can be triggered by the individual by pressing a mouse button or a keyboard key.
    [00172] The process according to the invention is implemented on a computer comprising at least one processor suitable for executing a computer program comprising instructions for implementing the process.
    [00173] It should be evident to those skilled in the art that any reference to a line of text should be considered alongside writing and reading a given language. Therefore, according to the language considered, a column instead of a line can be examined, without departing from the invention as claimed. Likewise, the zones of previous interest Z20, current Z21 and next Z22 as illustrated in figure 5 illustrate in a reading direction going from left to right, while some other languages, such as Arabic, use a writing sense. and opposite reading.
    [00174] The present invention also aims at a computer program comprising instructions for the implementation of the above process, when that program is executed by a processor. It also aims at a support (not transitory in particular) storing such a program. The computer program can be written in different programming languages, such as, for example, the PythonTM language. In addition, this program can be based on applications and / or programming interfaces designed to facilitate its development; such an application is, for example, known under the trade name PsychoPyTM and such a programming interface is, for example, the OpenGLTM interface.
    [00175] As described above, the process according to the invention can be installed using different materials to facilitate the visual exploration of different digital contents.
    [00176] For a first example given by way of illustration and not limitative, the display device may consist of a computer screen or tablet and the content considered may consist of a digital book or a virtual visit. The content can then be processed according to the process simultaneously for its visual exploration or upstream of one or any visual exploration. More particularly, the digital content of the virtual visit, from an art gallery for example, can be pre-treated by recognizing in it the works of art that are displayed there as objects included in object zones, so that those zones can be enriched in a different way. according to the invention process at the time of all future visual explorations to facilitate the visual exploration of the exposed works of art for any user.
    [00177] For a second example given by way of illustration and not limitation, the display device may consist of video or multimedia glasses lenses connected or not to a communication network, such as the Internet, and the digital image I displayed on the contact lenses. eyeglasses can then consist of all or part of a photograph of the eyeglass wearer's visual field. This photograph can be taken by a camera fitted over the glasses and updated continuously to be representative of what the wearer sees at any given moment through his glasses. Recognition of objects in this photograph can then also be carried out continuously, for example, the faces of people in the visual field of the wearer can be recognized as objects comprised in object zones, so that those zones can be enriched in a different way. according to the process of the invention, at least in order to facilitate the indication of said persons to the bearer. In this sense, the enriched object zone can also be continuously updated to be representative of movements, and more generally of any evolution in time, of recognized objects. First results were obtained for the recognition of objects and more particularly, the faces of people who are in the visual field of a carrier.
    [00178] About twenty carriers suffering from DMLA were subjected to the following face identification test. Nine faces are displayed on an image presented to the bearers: one face in the center and eight faces around it. The task is to find, between the faces that are around, the face that corresponds to the one in the middle and to read the figure that is inscribed on the selected face. The eight faces in the image are the same throughout the test, only the orientation and expression of your face changes and the face in the center varies from one test to the next. This face recognition was performed without visual aid and with the process of assisting visual exploration according to the invention.
    [00179] It was verified by a parametric test (Student test) a significant difference of the order of 31% between the recognition without visual aid and the recognition with the process of assisting the visual exploration according to the invention, in favor of the latter. This result is very encouraging because it shows an important increase in the performance of patients suffering from DMLA at the time of recognizing the faces of people in their visual field, when these patients use the process of assistance for visual exploration according to the invention.
    权利要求:
    Claims (20)
    [0001]
    1. Process (S) of assisting the visual exploration of a digital image (I) on a display device by a user suffering from a pathology of the retina resulting in a scotoma, the digital image being formed by a matrix of points divisible into zones , the process characterized by comprising the steps consisting of: - recognizing (S10) at least one object contained in an object zone (ZO) of the digital image, - determining (S30) a blind zone (Z1) in the image, corresponding to a scotoma position in the field of view of the user looking at the image, - in the case of detection of a proximity to the blind zone and the object zone, apply an image processing, to highlight (S70, S90) the object zone for the user, - determine (S50) a zone of interest (Z2) comprising at least one object zone (ZO), according to a blind zone positioning criterion (Z1) on the digital image, the blind zone being positionable on the display device by subjecting it to a pointing device, - display (S60) on the display device a mark (MZ2) allowing the visualization of the determined zone of interest (Z2), and in which the highlighting (S70, S90) of the object zone consists of: - enriching the zone of interest (Z2) determined by modifying it (S70) and reproducing it (S90) in a vision zone (Z3) according to at least one predetermined processing.
    [0002]
    2. Process according to claim 1, characterized by the positioning of the blind zone (Z1) on the digital image (I), according to which the zone of interest (Z2) is determined, to be chosen from: - one criterion of overlapping the zone of interest (Z2) by the blind zone (Z1), and - a criterion of overlapping the zone of interest (Z2) by a preferred fixation zone (PRL) determined for each individual, the positioning of that preferred zone of fixation (PRL) on the display device (D) in relation to the positioning of the blind zone (Z1) on that same device.
    [0003]
    Process according to claim 2, characterized by the said overlapping criterion consisting in determining: - the positioning of a specific point of the blind zone (Z1) or of the preferential fixation zone (PRL) on the zone of interest (Z2) , or - a larger area of overlap of the zone of interest (Z2) by the blind zone (Z1) or by the preferred fixation zone (PRL).
    [0004]
    Process according to any one of claims 1 to 3, characterized in that, when the zone of interest (Z2) is located near an edge of the display device (D) so that the viewing zone (Z3) would only be partially reproduced in the display device (D) according to said predetermined processing, the enrichment of the zone of interest (Z2) further consists of moving the viewing zone (Z3) so that the viewing zone is fully reproduced on the display device (D) and has a substantially maximum overlap with the viewing zone (Z3) that would only be partially reproduced on the display device (D) according to said predetermined processing.
    [0005]
    5. Process according to any one of claims 1 to 4, characterized by the fact that the object zone is highlighted (S70, S90) by the individual triggering, and eventually keeping triggered, a trigger, and the process also comprises, a step of returning to the digital image (I) before enrichment, this return being commanded by the individual by triggering, and eventually by slowing down, the trigger respectively.
    [0006]
    Method according to any one of claims 1 to 5, characterized in that at least one zone between the blind zone (Z1) and the viewing zone (Z3) comprises a visible marking on the display device.
    [0007]
    Process according to any one of claims 1 to 6, characterized by the fact that in the step of recognizing (S10) at least one object contained in an object zone (ZO) of the digital image, an object segmentation algorithm is used in relation to the background, which is based on the principle of figure-background segregation used in automatic image processing.
    [0008]
    Process according to any one of claims 1 to 7, characterized by the predetermined processing of the zone of interest (Z2) consisting of the progressive enlargement of the size of the zone of interest (Z2) and, eventually, the progressive displacement of the zone of interest (Z2). Z2) from an initial position in the digital image (I) until the zone of interest (Z2) occupies the viewing zone (Z3) on the display device (D), and the process also comprises a step of returning to the image digital (I) before enrichment consisting of a progressive decrease in the size of the enriched zone of interest (Z2) and, eventually, a progressive displacement of the position of the zone of interest (Z2) until the zone of interest (Z2) returns to the size of the zone of interest (Z2) and to the position of the zone of interest (Z2) before enrichment.
    [0009]
    9. Process according to any one of claims 1 to 6, characterized by the fact that the process (S) of assistance for visual exploration is a process of assistance for reading; the digital image (I) comprises a text to be read; wherein the step of recognizing (S10) at least one object contained in an object zone (ZO) of the digital image comprises character recognition software comprising the recognition of at least a part of text by segmenting the text into line zones (ZL), then the segmentation of each line zone (ZL) into word zones (ZM); the object zone (ZO) is a word zone (ZM); and the vision zone (Z3) is located on the periphery of the blind zone (Z1).
    [0010]
    Process according to claim 9, characterized in that it comprises, in addition, prior to the determination (S50) of the zone of interest (Z2), a step consisting of modifying the text image by resizing the text and / or by modifying the text. leading spacing depending on the size of the characters, the length and / or the number of lines, the size of the display device and / or the size of the blind zone.
    [0011]
    Process according to any one of claims 9 to 10, characterized in that the recognition (S10) of said at least part of the text further comprises the segmentation of each word zone (ZM) into letter zones.
    [0012]
    Process according to any one of claims 9 to 11, characterized in that the zone of interest (Z2) comprises, in addition to said at least one word zone (ZM), at least two other word zones belonging to the same line zone (ZL), each word zone of the zone of interest (Z2) being juxtaposed with another word zone of the zone of interest (Z2).
    [0013]
    Process according to any one of claims 9 to 12, characterized in that said at least one predetermined processing of the zone of interest (Z2) consists of: - a segmentation of each word zone (ZM) into character zones, and / or - an increase in the size of the characters, possibly due to the size of the blind zone (Z1), and / or - a change in the font of characters, and / or - an arrangement of words on several lines, and / or - a hyphenation of a word, and / or - an increase in spacing between characters, and / or - a change in contrast, and / or - an inversion of polarity, and / or - a vocal synthesis of the words contained in the zone of interest (Z2) .
    [0014]
    Process according to claim 13, characterized in that the size of the characters and / or the spacing between the characters is further increased, as the characters are intended to be reproduced (S90) in a line of the vision zone (Z3 ) furthest from the blind zone (Z1).
    [0015]
    Process according to any one of claims 9 to 14, characterized in that, in addition, a zone of previous interest (Z20) and / or a zone of next interest (Z22), located respectively on both sides, is determined (S50). sides of a zone of current interest (Z21), at least one of those zones comprising a visible marking on the display device.
    [0016]
    Process according to any one of claims 9 to 15, characterized in that it further comprises a step consisting of displaying on the display device (D), a mark (Z4) to the left of the line zone (ZL) located directly below the line zone comprising the zone of interest (Z2).
    [0017]
    Process according to any one of claims 1 to 16, characterized in that it comprises, prior to reproduction (S90) in the viewing zone (Z3) of the zone of interest (Z2) processed or prior to the determination (S50) of the zone of interest (Z2) according to a choice of positioning criteria, a step consisting of determining the peripheral position of the vision zone (Z3) in relation to the blind zone (Z1) as corresponding to the position of a determined preferential fixation zone (PRL) for each individual.
    [0018]
    18. Process according to claim 17, characterized by determining the peripheral position of the vision zone (Z3) in relation to the blind zone (Z1) comprising the calibration steps consisting of: - displaying a plurality of targets on the display device ( F), - for each target, detect, by an oculometer, the relative position of the scotoma (S) of the individual in relation to the target (F) when the individual fixes the target, and - calibrate the position of the preferred fixation zone (PRL ) as being the relative position of the target (F) in relation to the position of the scotoma, and - if the relative position of the scotoma (S) in relation to the position of the target (F) varies depending on the fixed target (F), - subject , depending on the calibration carried out in accordance with the preceding detections, the positioning of a shape contour (CF) displayed on the display device of the scotoma position detected by the oculometer, - display a target symbol (C) fixed on the display device , - measure the displacement (d) between the contour slave (CF) and the target symbol, when the individual has positioned the slave contour in order to include the target symbol (C) in it, and - correct, according to this measurement, the calibration performed according to previous detections.
    [0019]
    19. The method according to any one of claims 9 to 18, characterized in that the vision zone (Z3) is located juxtaposed and centered below or above the blind zone.
    [0020]
    20. Process according to any one of claims 1 to 19, characterized in that the pointing device, subjecting the positioning of the blind zone (Z1), is chosen between a computer keyboard, a mouse and an oculometer.
    类似技术:
    公开号 | 公开日 | 专利标题
    BR112016003520B1|2021-04-27|PROCESS OF ASSISTANCE TO THE VISUAL EXPLORATION OF A DIGITAL IMAGE IN A DISPLAY DEVICE BY A USER SUFFERING FROM A PATHOLOGY OF THE RETINA RESULTING IN A SCOTOMA
    Planton et al.2013|The “handwriting brain”: a meta-analysis of neuroimaging studies of motor versus orthographic processes
    Yan et al.2012|Lexical and sublexical semantic preview benefits in Chinese reading.
    Rayner1995|Eye movements and cognitive processes in reading, visual search, and scene perception
    Pelli et al.2008|The uncrowded window of object recognition
    Dalrymple et al.2013|A world unglued: simultanagnosia as a spatial restriction of attention
    US9946341B2|2018-04-17|Information observation method and information observation device
    Ludersdorfer et al.2015|Accessing orthographic representations from speech: The role of left ventral occipitotemporal cortex in spelling
    CA2849557A1|2014-10-22|Method and system using two parallel optical character recognition processes
    JP2018530790A|2018-10-18|Method for determining optical system of progressive lens
    Braet et al.2012|RETRACTED: The visual word form area is organized according to orthography
    Ibrahim et al.2012|The contribution of the two hemispheres to lexical decision in different languages
    Wang et al.2016|Cross-language parafoveal semantic processing: Evidence from Korean–Chinese bilinguals
    Zhou et al.2013|A validation of parafoveal semantic information extraction in reading Chinese
    Leong et al.1985|Differential cerebral involvement in perceiving Chinese characters: Levels of processing approach
    Drieghe et al.2017|Parafoveal preview effects in reading unspaced text.
    Sakurai et al.2001|Pure alexia from a posterior occipital lesion
    Yan et al.2015|Parafoveal-on-foveal effects of emotional word semantics in reading Chinese sentences: Evidence from eye movements.
    Shan et al.2010|Implicit reading in Chinese pure alexia
    Hsu et al.2000|Image mining in IRIS: Integrated retinal information system
    Huang et al.2012|Neural strategies for reading Japanese and Chinese sentences: A cross-linguistic fMRI study of character-decoding and morphosyntax
    Miller-Naudé et al.2017|Visual Grammar: An eye-tracking perspective on cognitive complexity in Biblical Hebrew pronunciation
    Wang et al.2021|The perceptual span in Tibetan reading
    Di Pietro et al.2012|Preserved visual language identification despite severe alexia
    Ahr et al.2018|Behavioral evidence of the inhibition of mirror generalization for reversible letters at a perceptual stage of processing
    同族专利:
    公开号 | 公开日
    US20160198941A1|2016-07-14|
    WO2015024790A1|2015-02-26|
    CA2921476C|2022-01-04|
    JP2016530562A|2016-09-29|
    CN105637570B|2019-07-02|
    KR102306768B1|2021-09-30|
    CN105637570A|2016-06-01|
    CA2921476A1|2015-02-26|
    KR20160046802A|2016-04-29|
    JP6502351B2|2019-04-17|
    US9861274B2|2018-01-09|
    EP3036733A1|2016-06-29|
    引用文献:
    公开号 | 申请日 | 公开日 | 申请人 | 专利标题
    US5589897A|1995-05-01|1996-12-31|Stephen H. Sinclair|Method and apparatus for central visual field mapping and optimization of image presentation based upon mapped parameters|
    FR2846120B1|2002-10-21|2005-04-15|Inst Sciences De La Vision|METHOD FOR DEMASQUISHING VISUAL INFORMATION PRESENTED IN A LITTLE OR NOT FUNCTIONAL VISUAL AREA AND THE DEVICE FOR IMPLEMENTING THE SAME|
    CN1259635C|2003-06-18|2006-06-14|摩托罗拉公司|Method for identification of text line|
    WO2007107949A1|2006-03-23|2007-09-27|Koninklijke Philips Electronics N.V.|Hotspots for eye track control of image manipulation|
    EP2143273A4|2007-04-02|2012-08-08|Esight Corp|An apparatus and method for augmenting sight|
    US8197065B2|2009-08-03|2012-06-12|Nike, Inc.|Vision testing and/or training using adaptable visual indicia|
    CN103065521B|2011-10-19|2015-03-18|北京奥美达科技有限公司|Visual aid and intelligent marking method|FR3039978A1|2015-08-14|2017-02-17|Essilor Int |METHOD FOR DETERMINING VISUAL AID MEANS IN RELATION TO THE BEHAVIOR OF AN INDIVIDUAL SUBJECT TO A TEST|
    US10765314B2|2016-05-29|2020-09-08|Novasight Ltd.|Display system and method|
    US10347050B1|2016-09-22|2019-07-09|Apple Inc.|Augmented reality device to warp images|
    JP6805733B2|2016-10-31|2020-12-23|オムロン株式会社|Control system, its control method and its computer-readable storage medium|
    CN106943116B|2017-03-13|2018-10-12|广东顺德中山大学卡内基梅隆大学国际联合研究院|A kind of infant eyesight automatic testing method|
    US10805676B2|2017-07-10|2020-10-13|Sony Corporation|Modifying display region for people with macular degeneration|
    US10650702B2|2017-07-10|2020-05-12|Sony Corporation|Modifying display region for people with loss of peripheral vision|
    US10845954B2|2017-07-11|2020-11-24|Sony Corporation|Presenting audio video display options as list or matrix|
    US10303427B2|2017-07-11|2019-05-28|Sony Corporation|Moving audio from center speaker to peripheral speaker of display device for macular degeneration accessibility|
    US11113985B2|2017-08-30|2021-09-07|Focus Reading Technology Inc.|Visual acuity measurement apparatus|
    DE102018106125B4|2018-03-16|2019-09-26|Carl Zeiss Vision International Gmbh|Apparatus and method for detecting a visual field of a person having a scotoma|
    CN110584587A|2019-09-03|2019-12-20|北京爱博同心医学科技有限公司|Method and device for compensating visual field defect|
    法律状态:
    2018-08-14| B25A| Requested transfer of rights approved|Owner name: CENTRE NATIONAL DE LA RECHERCHE SCIENTIFIQUE (CNRS |
    2020-04-28| B06U| Preliminary requirement: requests with searches performed by other patent offices: procedure suspended [chapter 6.21 patent gazette]|
    2021-03-09| B09A| Decision: intention to grant [chapter 9.1 patent gazette]|
    2021-04-27| B16A| Patent or certificate of addition of invention granted [chapter 16.1 patent gazette]|Free format text: PRAZO DE VALIDADE: 20 (VINTE) ANOS CONTADOS A PARTIR DE 07/08/2014, OBSERVADAS AS CONDICOES LEGAIS. |
    优先权:
    申请号 | 申请日 | 专利标题
    EP13306159|2013-08-21|
    EP13306159.8|2013-08-21|
    PCT/EP2014/067017|WO2015024790A1|2013-08-21|2014-08-07|Method for assisting visual exploration for an individual suffering from a retinal condition resulting in a scotoma|
    [返回顶部]